1
00:00:05,360 --> 00:00:09,360
REPORTER: Good morning, New Yorkers.
Another beautiful day in the city.

2
00:00:12,880 --> 00:00:15,960
The Marriott hotel,
midtown Manhattan.

3
00:00:18,800 --> 00:00:22,520
The CEO of
the largest health insurer in America

4
00:00:22,520 --> 00:00:25,360
sets out for a meeting of investors.

5
00:00:29,080 --> 00:00:34,080
But as he reaches the venue,
<font color="

6
00:00:36,000 --> 00:00:38,040
Breaking news - we're just hearing

7
00:00:38,040 --> 00:00:40,440
that the CEO of UnitedHealthcare,

8
00:00:40,440 --> 00:00:42,720
which is the largest
healthcare company in the country,

9
00:00:42,720 --> 00:00:45,840
was shot and killed
right here in New York.

10
00:00:45,840 --> 00:00:48,280
Brian Thompson was shot
<font color="

11
00:00:48,280 --> 00:00:51,280
Police believe the shooting
was a targeted killing.

12
00:00:51,280 --> 00:00:56,280
The shooting of the father
of two led to a nationwide manhunt.

13
00:00:56,280 --> 00:00:59,640
Five days later,
a suspect was arrested.

14
00:00:59,640 --> 00:01:05,880
26-year-old Luigi Mangione became
<font color="

15
00:01:05,880 --> 00:01:11,320
Luigi Mangione, who has also been
dubbed America's Hot Assassin.

16
00:01:11,320 --> 00:01:16,440
Instead of denouncing the killing,
some seemed to cheer it on...

17
00:01:16,440 --> 00:01:19,800
ALL CHANTING: We the people
want Luigi free!

18
00:01:19,800 --> 00:01:23,800
..furious about
<font color="

19
00:01:23,800 --> 00:01:26,160
But what few people realise

20
00:01:26,160 --> 00:01:30,280
is that this is a story
about artificial intelligence...

21
00:01:34,120 --> 00:01:37,920
..and the growing use of AI
in modern healthcare.

22
00:01:40,920 --> 00:01:47,200
They're using AI to maximise
the profits off of their clients.

23
00:01:47,200 --> 00:01:50,200
<font color="
life-and-death decisions

24
00:01:50,200 --> 00:01:53,800
are no longer made by doctors,
but by machines?

25
00:01:57,120 --> 00:02:01,840
ADVERT: Artificial intelligence -
a machine beyond the mind of man.

26
00:02:01,840 --> 00:02:06,880
For decades, scientists have dreamed
of creating incredible machines

27
00:02:06,880 --> 00:02:11,640
<font color="
learn like us, think like us.

28
00:02:14,240 --> 00:02:19,320
But what we didn't imagine
is the impact they would have on us.

29
00:02:19,320 --> 00:02:22,040
In this series,
I'm exploring what happens

30
00:02:22,040 --> 00:02:25,240
when AI collides with human lives,

31
00:02:25,240 --> 00:02:30,240
unearthing stories far stranger than
<font color="

32
00:02:55,440 --> 00:02:57,960
I'm Professor Hannah Fry,
and for years,

33
00:02:57,960 --> 00:03:01,880
I've been interested in
how AI could transform healthcare.

34
00:03:01,880 --> 00:03:04,280
What I couldn't predict is
that it would take me

35
00:03:04,280 --> 00:03:07,880
to the scene of a murder
<font color="

36
00:03:08,920 --> 00:03:11,360
Hey, Hannah. Hi.
How are you doing? Good.

37
00:03:11,360 --> 00:03:14,240
Nice to meet you. I'm Hannah.
Lovely to meet you.

38
00:03:14,240 --> 00:03:17,960
Hannah Parry is a journalist for
Newsweek who lives in New York

39
00:03:17,960 --> 00:03:21,280
<font color="
the day Brian Thompson was shot.

40
00:03:21,280 --> 00:03:23,680
When did you first hear about it?

41
00:03:23,680 --> 00:03:27,320
Well, we first heard the reports of
a shooting up in midtown,

42
00:03:27,320 --> 00:03:30,920
but it quickly came through that
it was something more than that.

43
00:03:30,920 --> 00:03:34,720
We were able to see
<font color="

44
00:03:35,960 --> 00:03:39,000
Hi, I'm Brian Thompson,
CEO of UnitedHealthcare,

45
00:03:39,000 --> 00:03:42,160
and welcome to the attendees of
Reuters Total Health.

46
00:03:42,160 --> 00:03:43,320
Our mission...

47
00:03:43,320 --> 00:03:45,160
This polished corporate video

48
00:03:45,160 --> 00:03:48,440
shows Brian Thompson
addressing a conference

49
00:03:48,440 --> 00:03:52,960
<font color="
CEO of UnitedHealthcare,

50
00:03:52,960 --> 00:03:58,000
America's largest insurer,
with over 50 million customers.

51
00:03:58,000 --> 00:04:00,360
On the morning of his death,
he was on his way

52
00:04:00,360 --> 00:04:04,880
to the company's annual
investor meeting on West 54th Street.

53
00:04:04,880 --> 00:04:08,400
<font color="
where the conference was being held,

54
00:04:08,400 --> 00:04:12,000
and that's the surveillance camera
that captured the shocking footage.

55
00:04:12,000 --> 00:04:13,640
GUNSHOT

56
00:04:14,800 --> 00:04:16,680
There were multiple bullet casings,

57
00:04:16,680 --> 00:04:20,160
and that kind of became
one of the key parts of the case.

58
00:04:20,160 --> 00:04:23,040
<font color="
three words on them,

59
00:04:23,040 --> 00:04:26,800
which were the words
"delay, deny, depose."

60
00:04:26,800 --> 00:04:29,200
Those words are extremely similar to

61
00:04:29,200 --> 00:04:32,120
a very well-known critique of
the insurance industry -

62
00:04:32,120 --> 00:04:37,600
rather than prove claims, they would
<font color="

63
00:04:37,600 --> 00:04:39,440
It appeared clear that the suspect

64
00:04:39,440 --> 00:04:42,400
had something to say about
the insurance industry.

65
00:04:43,600 --> 00:04:45,680
In the months prior to the shooting,

66
00:04:45,680 --> 00:04:49,920
reports were circulating about
UnitedHealthcare's use of AI

67
00:04:49,920 --> 00:04:55,120
in deciding when to pay out
<font color="

68
00:04:57,720 --> 00:05:01,240
A new investigation alleges
one healthcare giant

69
00:05:01,240 --> 00:05:04,360
may have been giving the algorithms
too much power.

70
00:05:04,360 --> 00:05:06,920
UnitedHealth pressured
its medical staff

71
00:05:06,920 --> 00:05:13,240
to cut off payments in lockstep with
<font color="

72
00:05:13,240 --> 00:05:15,560
This news report's from 2023,

73
00:05:15,560 --> 00:05:20,120
which is a year before
Brian Thompson was shot.

74
00:05:20,120 --> 00:05:21,880
I think if you don't live in America,

75
00:05:21,880 --> 00:05:24,440
you've probably never even heard
of UnitedHealthcare

76
00:05:24,440 --> 00:05:26,520
until this Luigi story surfaced.

77
00:05:26,520 --> 00:05:30,160
<font color="
going on with them.

78
00:05:30,160 --> 00:05:33,440
And at the heart of it all
are algorithms

79
00:05:33,440 --> 00:05:35,600
and artificial intelligence.

80
00:05:39,640 --> 00:05:41,480
The potential for AI

81
00:05:41,480 --> 00:05:45,640
to transform healthcare
for the better is enormous,

82
00:05:45,640 --> 00:05:48,720
and some of it is already here.

83
00:05:48,720 --> 00:05:51,720
<font color="
medical superintelligence -

84
00:05:51,720 --> 00:05:53,960
that's what the CEO of Microsoft
is calling

85
00:05:53,960 --> 00:05:57,000
the company's
new artificial intelligence tool.

86
00:05:57,000 --> 00:05:59,560
From accelerating drug development...

87
00:05:59,560 --> 00:06:01,760
A revolution in drug discovery

88
00:06:01,760 --> 00:06:04,920
could cure cancer
<font color="

89
00:06:04,920 --> 00:06:08,640
by bringing new approaches
to once impossible problems.

90
00:06:08,640 --> 00:06:11,680
..to reading scans
and detecting diseases...

91
00:06:11,680 --> 00:06:13,200
See that little square? Yeah.

92
00:06:13,200 --> 00:06:16,360
It finds a very subtle polyp
that maybe you would have missed.

93
00:06:16,360 --> 00:06:20,080
<font color="
during complex operations.

94
00:06:20,080 --> 00:06:23,840
A 3D map of a patient's pelvis
is generated from a CAT scan

95
00:06:23,840 --> 00:06:27,440
to help guide the surgeon
in real time.

96
00:06:27,440 --> 00:06:31,120
In the UK, AI is already being used
in the NHS

97
00:06:31,120 --> 00:06:33,280
<font color="

98
00:06:33,280 --> 00:06:36,680
and to identify
early signs of lung cancer.

99
00:06:36,680 --> 00:06:41,160
For our overstretched health service,
this technology has huge potential

100
00:06:41,160 --> 00:06:44,520
to boost efficiency
and bring down costs.

101
00:06:44,520 --> 00:06:46,920
The revolution
<font color="

102
00:06:46,920 --> 00:06:51,680
offers a golden opportunity to
deliver better care at better value,

103
00:06:51,680 --> 00:06:55,240
and the NHS will usher in
a new age of medicine,

104
00:06:55,240 --> 00:06:58,880
leapfrogging disease so
we are predicting and preventing it,

105
00:06:58,880 --> 00:07:02,000
rather than just diagnosing
<font color="

106
00:07:06,920 --> 00:07:10,960
In the US,
healthcare is a huge business.

107
00:07:10,960 --> 00:07:12,960
I wanted to find out more about
the claims

108
00:07:12,960 --> 00:07:15,520
that UnitedHealthcare
had been using an AI

109
00:07:15,520 --> 00:07:18,600
to make crucial
life and-death decisions...

110
00:07:19,960 --> 00:07:21,480
<font color="

111
00:07:21,480 --> 00:07:25,120
working in the oldest
homeless shelter in Los Angeles.

112
00:07:25,120 --> 00:07:26,880
OK, so let me take a look.

113
00:07:26,880 --> 00:07:30,640
Mary Marfisee is a medical director
at the Union Rescue Mission.

114
00:07:30,640 --> 00:07:33,320
SPANISH TRANSLATION:

115
00:07:33,320 --> 00:07:34,560
OK?

116
00:07:35,960 --> 00:07:38,120
<font color="

117
00:07:38,120 --> 00:07:41,360
Nice to meet you. It's lovely
to meet you. How are you doing?

118
00:07:41,360 --> 00:07:43,120
I want to give you a little tour.

119
00:07:43,120 --> 00:07:44,680
Mary has spent her career

120
00:07:44,680 --> 00:07:48,360
providing medical care
to the city's most vulnerable.

121
00:07:48,360 --> 00:07:51,560
<font color="
when her family needed help,

122
00:07:51,560 --> 00:07:55,160
she believes they found themselves
at the mercy of AI.

123
00:07:55,160 --> 00:07:58,200
Mary, is that your hat?
It's my husband's hat.

124
00:07:58,200 --> 00:08:01,960
Oh, that's lovely. I thought
I'd bring it with me today.

125
00:08:03,440 --> 00:08:06,200
<font color="
older white guys?

126
00:08:06,200 --> 00:08:08,640
He looks so English. He was Welsh.
HANNAH LAUGHS

127
00:08:08,640 --> 00:08:10,320
He was American-Welsh.

128
00:08:10,320 --> 00:08:14,200
The story with your husband -
when did this all start?

129
00:08:14,200 --> 00:08:16,320
Going back about three years ago,

130
00:08:16,320 --> 00:08:18,920
<font color="
a lot of balance problems,

131
00:08:18,920 --> 00:08:22,720
just falling too many times,
and this was a very athletic man.

132
00:08:22,720 --> 00:08:27,400
And then finally, one fall
that was so bad fractured his nose

133
00:08:27,400 --> 00:08:29,120
and his face was filled with blood

134
00:08:29,120 --> 00:08:31,280
and had some cranial fractures
<font color="

135
00:08:31,280 --> 00:08:33,760
Got him in the hospital
and finally got a diagnosis,

136
00:08:33,760 --> 00:08:36,080
which was accumulation of fluid
on the brain.

137
00:08:36,080 --> 00:08:38,480
Oh, my gosh. Right.

138
00:08:38,480 --> 00:08:42,320
Oh, wow. That's a proper fall.
Yeah, it was rough.

139
00:08:42,320 --> 00:08:43,760
So, what happened?

140
00:08:43,760 --> 00:08:45,160
<font color="

141
00:08:45,160 --> 00:08:48,320
and then he got into
a rehabilitation centre.

142
00:08:48,320 --> 00:08:51,320
And then,
within just a couple of weeks,

143
00:08:51,320 --> 00:08:52,840
I was told by the centre,

144
00:08:52,840 --> 00:08:56,200
"OK, his time is up.
He's no longer in need of services."

145
00:08:56,200 --> 00:08:58,600
And I said, "What?
<font color="

146
00:08:58,600 --> 00:09:00,600
"He can't go to the bathroom
on his own."

147
00:09:00,600 --> 00:09:02,640
And I thought,
"Something's not right here."

148
00:09:02,640 --> 00:09:04,640
So, we got him home, and then again,

149
00:09:04,640 --> 00:09:06,720
another fall
within just a few months.

150
00:09:06,720 --> 00:09:09,680
And the same thing I was told by
<font color="

151
00:09:09,680 --> 00:09:11,720
And any time
I would complain about it,

152
00:09:11,720 --> 00:09:14,680
I'd hear, "Oh, well, at his age,"

153
00:09:14,680 --> 00:09:17,920
and I got tired of hearing
that preamble.

154
00:09:17,920 --> 00:09:19,640
So, when he was discharged,

155
00:09:19,640 --> 00:09:23,400
if he's not in a fit state to walk
<font color="

156
00:09:23,400 --> 00:09:26,400
Wheelchair.
Just wheelchair to the car.

157
00:09:26,400 --> 00:09:30,200
Staff takes him out, loads him
in my car and I drive away.

158
00:09:30,200 --> 00:09:32,640
And how'd you get him
in the house on the other end?

159
00:09:32,640 --> 00:09:34,040
It was a struggle.

160
00:09:34,040 --> 00:09:37,120
<font color="
I dislocated my right shoulder.

161
00:09:37,120 --> 00:09:40,160
Cos this is just not a man
who's strong enough to be back home.

162
00:09:40,160 --> 00:09:42,280
Right. No, it wasn't good.

163
00:09:42,280 --> 00:09:45,120
And that's when I started calling
UnitedHealthcare, saying,

164
00:09:45,120 --> 00:09:46,840
"Who's making these decisions?"

165
00:09:46,840 --> 00:09:51,480
<font color="
"Clinical team." Right.

166
00:09:51,480 --> 00:09:55,920
And I started to say things like,
"Well, who runs the clinical team?"

167
00:09:55,920 --> 00:09:58,000
And then I would just get
the run-around.

168
00:09:58,000 --> 00:10:02,800
So I called the ombudsman and that's
<font color="

169
00:10:02,800 --> 00:10:04,240
OK.

170
00:10:04,240 --> 00:10:07,920
After each fall, he wasn't
getting enough physical therapy

171
00:10:07,920 --> 00:10:09,480
or occupational therapy.

172
00:10:09,480 --> 00:10:13,000
You just get weaker and weaker
over time. Yeah. Yeah.

173
00:10:15,640 --> 00:10:18,040
<font color="
when he did?

174
00:10:18,040 --> 00:10:20,120
I don't think so.

175
00:10:20,120 --> 00:10:22,200
He had goals to live much longer.

176
00:10:23,560 --> 00:10:27,320
I really thought he could get back
to some of his function.

177
00:10:27,320 --> 00:10:30,680
Had he been given the care he needed?
Yes, I think so.

178
00:10:32,640 --> 00:10:35,280
<font color="

179
00:10:36,920 --> 00:10:39,920
It's more.
I miss him more than anger.

180
00:10:39,920 --> 00:10:42,280
I don't want it to happen
to anybody else.

181
00:10:46,840 --> 00:10:48,960
Thanks for coming.
Thank you so much.

182
00:10:48,960 --> 00:10:51,520
I got to give you a hug because
it meant so much to have you.

183
00:10:51,520 --> 00:10:53,600
<font color="
I'll send you some things.

184
00:10:53,600 --> 00:10:55,080
Thank you, thank you.

185
00:10:59,080 --> 00:11:01,400
There's a kind of irony
to this story.

186
00:11:01,400 --> 00:11:04,920
You have somebody
who spent her entire life

187
00:11:04,920 --> 00:11:06,680
advocating for people's health,

188
00:11:06,680 --> 00:11:09,480
trying to make sure that they get
<font color="

189
00:11:09,480 --> 00:11:12,360
When she needed it,
when her family needed it,

190
00:11:12,360 --> 00:11:16,040
despite having paid for it,
it wasn't available.

191
00:11:17,680 --> 00:11:20,800
Frank and Mary's case
was not an isolated one.

192
00:11:21,880 --> 00:11:26,120
By early 2023,
the story was starting to get out -

193
00:11:26,120 --> 00:11:30,760
<font color="
AI algorithms by big insurers,

194
00:11:30,760 --> 00:11:35,200
including UnitedHealthcare,
to deny elderly patients care.

195
00:11:36,600 --> 00:11:40,000
Later that year,
there was a Senate inquiry.

196
00:11:40,000 --> 00:11:43,000
The reason we're here today
is that all too often,

197
00:11:43,000 --> 00:11:44,480
<font color="

198
00:11:44,480 --> 00:11:47,320
have been failing seniors
when they need care.

199
00:11:47,320 --> 00:11:51,760
And perhaps most troubling of all,
there is growing evidence

200
00:11:51,760 --> 00:11:54,520
that insurance companies
are relying on algorithms,

201
00:11:54,520 --> 00:11:57,280
rather than doctors
or other clinicians,

202
00:11:57,280 --> 00:12:01,080
<font color="
to deny patient care.

203
00:12:02,520 --> 00:12:06,800
Two months after the Senate committee
published its report,

204
00:12:06,800 --> 00:12:09,120
Brian Thompson was shot.

205
00:12:09,120 --> 00:12:11,360
Let's head to New York
because police there

206
00:12:11,360 --> 00:12:13,840
are continuing their hunt
for the gunman

207
00:12:13,840 --> 00:12:16,760
<font color="
the biggest companies in the world.

208
00:12:16,760 --> 00:12:19,720
The shooter took off
down an alleyway around 55th Street

209
00:12:19,720 --> 00:12:21,840
and is currently still at large.

210
00:12:21,840 --> 00:12:23,680
In the days after the shooting,

211
00:12:23,680 --> 00:12:27,200
the hunt for Brian Thompson's killer
gripped the nation.

212
00:12:27,200 --> 00:12:29,040
<font color="

213
00:12:29,040 --> 00:12:32,400
described as a man about 6'1"
wearing all black.

214
00:12:32,400 --> 00:12:36,160
Police drones, helicopters
and thousands of CCTV cameras

215
00:12:36,160 --> 00:12:38,280
are combing the city
street by street.

216
00:12:38,280 --> 00:12:40,760
On Thursday,
detectives shared new images

217
00:12:40,760 --> 00:12:43,040
<font color="

218
00:12:43,040 --> 00:12:45,120
The image
caught on surveillance camera

219
00:12:45,120 --> 00:12:48,760
shows him standing at
the check-in desk at a hostel.

220
00:12:48,760 --> 00:12:51,440
The man appears relaxed and smiling.

221
00:12:51,440 --> 00:12:53,000
Just a few minutes later,

222
00:12:53,000 --> 00:12:56,280
he shot Mr Thompson dead
<font color="

223
00:12:57,440 --> 00:13:01,160
Then, five days after the killing,
police received a tip-off

224
00:13:01,160 --> 00:13:05,000
from an employee
at a McDonald's in Pennsylvania.

225
00:13:22,320 --> 00:13:26,240
REPORT: The alleged killer has been
identified as Luigi Mangione.

226
00:13:27,640 --> 00:13:30,400
<font color="
after his arrest,

227
00:13:30,400 --> 00:13:33,000
it was clear he had something to say.

228
00:13:47,400 --> 00:13:49,680
Luigi Mangione,
the man accused of killing

229
00:13:49,680 --> 00:13:52,800
the US healthcare insurance
chief executive, Brian Thompson,

230
00:13:52,800 --> 00:13:56,320
appeared in New York
<font color="

231
00:13:56,320 --> 00:13:59,880
that could lead to
a death penalty sentence.

232
00:13:59,880 --> 00:14:02,440
Then something extraordinary
happened.

233
00:14:02,440 --> 00:14:07,280
PROTESTERS CHANTING: Free Luigi!
Free Luigi!

234
00:14:07,280 --> 00:14:12,680
Almost immediately, protesters
<font color="

235
00:14:12,680 --> 00:14:15,560
hailing him as a folk hero.

236
00:14:15,560 --> 00:14:18,640
I'm here because I support
universal healthcare for all,

237
00:14:18,640 --> 00:14:20,360
and I'm here because I believe that

238
00:14:20,360 --> 00:14:23,280
Luigi Mangione's civil rights
are being violated.

239
00:14:23,280 --> 00:14:25,080
So, what brought you here today?

240
00:14:25,080 --> 00:14:27,040
<font color="

241
00:14:27,040 --> 00:14:29,720
I think everybody in the crowd
identifies with

242
00:14:29,720 --> 00:14:32,360
the extortionist nature
of our American healthcare.

243
00:14:32,360 --> 00:14:35,560
They implemented, like, an AI bot
to review the claims.

244
00:14:35,560 --> 00:14:38,000
Some of those people
<font color="

245
00:14:38,000 --> 00:14:40,040
that were rejected for efficiency.

246
00:14:40,040 --> 00:14:42,200
What's your feeling
in general about AI?

247
00:14:42,200 --> 00:14:45,760
I mean, technology is going
to find its way into everything,

248
00:14:45,760 --> 00:14:49,240
so to stand against it,
you become a fossil.

249
00:14:49,240 --> 00:14:52,040
<font color="
to invest into

250
00:14:52,040 --> 00:14:54,120
the human components of things
because as we saw,

251
00:14:54,120 --> 00:14:55,800
you can't just automate everything,
right?

252
00:14:55,800 --> 00:14:57,960
Somebody has to be looking
and watching over.

253
00:14:57,960 --> 00:15:01,760
<font color="
People are dying!

254
00:15:03,920 --> 00:15:07,280
I myself have had a terrible
experience with American healthcare,

255
00:15:07,280 --> 00:15:09,520
despite having
one of the better plans.

256
00:15:09,520 --> 00:15:12,920
Both my mom and I have had to battle

257
00:15:12,920 --> 00:15:16,200
and fight tooth and nail
<font color="

258
00:15:16,200 --> 00:15:17,840
It's really insidious,

259
00:15:17,840 --> 00:15:20,760
the way that AI is infecting
every aspect of our society,

260
00:15:20,760 --> 00:15:23,840
but specifically
something so important and crucial,

261
00:15:23,840 --> 00:15:27,800
such as healthcare that already
shouldn't be for profit.

262
00:15:27,800 --> 00:15:31,080
<font color="

263
00:15:31,080 --> 00:15:35,320
the profits that they can make
off of their clients.

264
00:15:35,320 --> 00:15:39,640
Stop denials with AI!
How many people have to die?

265
00:15:39,640 --> 00:15:43,920
In this site, incredible strength
of feeling from the protesters.

266
00:15:43,920 --> 00:15:45,600
You can understand, too.

267
00:15:45,600 --> 00:15:47,640
<font color="
personally affected by this

268
00:15:47,640 --> 00:15:49,760
or if someone in your family has,

269
00:15:49,760 --> 00:15:53,880
I understand why this is
such an emotional moment.

270
00:15:53,880 --> 00:15:57,920
But, you know, I also think that
someone was murdered here,

271
00:15:57,920 --> 00:16:01,000
someone with a family, with children,

272
00:16:01,000 --> 00:16:03,760
<font color="
a bit of mental gymnastics

273
00:16:03,760 --> 00:16:05,400
going on with these protesters

274
00:16:05,400 --> 00:16:08,840
where they sort of conveniently
manage to forget that fact.

275
00:16:08,840 --> 00:16:12,120
Free Luigi! Free Luigi!

276
00:16:15,920 --> 00:16:19,560
In situations like these
where emotions are high,

277
00:16:19,560 --> 00:16:22,360
<font color="
to turn on technology,

278
00:16:22,360 --> 00:16:26,360
especially when it feels like it's
something we don't fully understand

279
00:16:26,360 --> 00:16:28,400
and can't easily control.

280
00:16:29,600 --> 00:16:33,560
AI didn't create the perceived
problems with US healthcare,

281
00:16:33,560 --> 00:16:36,480
but it has supercharged them,

282
00:16:36,480 --> 00:16:38,280
<font color="

283
00:16:38,280 --> 00:16:43,280
it helps to know
what an AI algorithm actually is.

284
00:16:43,280 --> 00:16:46,480
I think the words "algorithm" and
"AI" get thrown around quite a lot.

285
00:16:46,480 --> 00:16:47,960
It gets quite confusing,

286
00:16:47,960 --> 00:16:50,560
so I thought I would explain the
difference between the two

287
00:16:50,560 --> 00:16:52,520
<font color="

288
00:16:52,520 --> 00:16:56,600
by imagining that you are
opening up a new hot dog stand.

289
00:16:56,600 --> 00:16:58,680
Now, you've got
a couple of options here.

290
00:16:58,680 --> 00:17:00,680
You could use an algorithm.

291
00:17:01,800 --> 00:17:05,680
An algorithm is a series of steps
for completing a task.

292
00:17:07,280 --> 00:17:11,440
<font color="
the task is to sell hot dogs.

293
00:17:14,040 --> 00:17:17,440
The inputs are the sausages,
the onions.

294
00:17:17,440 --> 00:17:20,480
The algorithm is the instructions -

295
00:17:20,480 --> 00:17:22,960
cook 100 hot dogs a day,

296
00:17:22,960 --> 00:17:24,840
sell them for $4 each,

297
00:17:24,840 --> 00:17:27,960
stay open till 11 on Friday -

298
00:17:27,960 --> 00:17:31,760
<font color="
is hopefully a tidy profit.

299
00:17:31,760 --> 00:17:33,480
CASH REGISTER CHIMES

300
00:17:33,480 --> 00:17:35,760
With this traditional type
of algorithm,

301
00:17:35,760 --> 00:17:37,840
everything is spelled out in advance.

302
00:17:37,840 --> 00:17:40,520
It means it's very precise,
it's very reliable,

303
00:17:40,520 --> 00:17:43,640
but it's also completely inflexible.

304
00:17:43,640 --> 00:17:48,080
<font color="
that is run by an AI algorithm.

305
00:17:48,080 --> 00:17:50,440
So, this time,
you don't tell it what to do.

306
00:17:50,440 --> 00:17:53,680
You just give it the inputs -
the buns, the sausages, the onions -

307
00:17:53,680 --> 00:17:56,480
and you say,
"The only thing I care about

308
00:17:56,480 --> 00:17:58,800
<font color="

309
00:17:58,800 --> 00:18:01,960
Now, at first,
AI is just going to watch.

310
00:18:01,960 --> 00:18:03,720
It's just going to collect data.

311
00:18:03,720 --> 00:18:07,320
It's going to hunt for patterns like
when people are buying the most,

312
00:18:07,320 --> 00:18:09,200
where has the most footfall,

313
00:18:09,200 --> 00:18:11,280
how that changes with the weather.

314
00:18:11,280 --> 00:18:13,000
<font color="

315
00:18:13,000 --> 00:18:16,440
it's going to start suggesting things
that you hadn't even thought of,

316
00:18:16,440 --> 00:18:19,080
like pitch up outside a dog park
on Sundays

317
00:18:19,080 --> 00:18:21,720
or start selling vegetarian sausages

318
00:18:21,720 --> 00:18:25,720
or people tip more
when the cart smells like onions.

319
00:18:25,720 --> 00:18:28,680
<font color="
tell the AI any of those rules.

320
00:18:28,680 --> 00:18:30,640
It discovered them for itself.

321
00:18:31,720 --> 00:18:34,120
AI algorithms are capable
of crunching

322
00:18:34,120 --> 00:18:36,280
huge quantities of data

323
00:18:36,280 --> 00:18:39,560
and analysing
complex patterns of behaviour,

324
00:18:39,560 --> 00:18:43,400
all in order to make
<font color="

325
00:18:46,880 --> 00:18:49,240
And that is
the really key difference here.

326
00:18:49,240 --> 00:18:51,840
For an AI algorithm,
you don't need to spell out

327
00:18:51,840 --> 00:18:54,040
every possible scenario in advance.

328
00:18:54,040 --> 00:18:59,480
You just define the goal
and let the AI learn for itself.

329
00:19:01,520 --> 00:19:07,040
<font color="
doesn't mean it's necessarily better,

330
00:19:07,040 --> 00:19:11,480
but it will ruthlessly pursue
whatever goal it's set.

331
00:19:13,000 --> 00:19:14,880
I wanted to find out more

332
00:19:14,880 --> 00:19:19,160
about the specific algorithm
being used by UnitedHealthcare,

333
00:19:19,160 --> 00:19:22,640
so I tracked down
<font color="

334
00:19:22,640 --> 00:19:25,400
who were the first
to uncover the story.

335
00:19:25,400 --> 00:19:28,800
Hey. Hey, how are you? How you doing?
Good to meet you.

336
00:19:28,800 --> 00:19:30,560
I'm Hannah. Nice to meet you.
Lovely to meet you.

337
00:19:30,560 --> 00:19:33,280
<font color="
How are you doing? Good.

338
00:19:33,280 --> 00:19:35,560
Casey Ross and Bob Herman

339
00:19:35,560 --> 00:19:39,200
were nominated for a Pulitzer Prize
for their investigation.

340
00:19:39,200 --> 00:19:42,680
How big has this story been for you
in terms of your journalistic career?

341
00:19:42,680 --> 00:19:45,400
<font color="
the biggest story that I've done

342
00:19:45,400 --> 00:19:47,400
in terms of the impact
that it's had.

343
00:19:47,400 --> 00:19:49,440
I think that the reaction that
we got

344
00:19:49,440 --> 00:19:52,880
and some of the fallout in terms of
lawsuits and the US Senate

345
00:19:52,880 --> 00:19:57,000
validate that this was a story
<font color="

346
00:19:57,000 --> 00:19:59,480
What was the first spark of
the story?

347
00:19:59,480 --> 00:20:02,280
This person in the nursing home
industry sent me an email,

348
00:20:02,280 --> 00:20:05,280
and it was just
this visceral reaction that,

349
00:20:05,280 --> 00:20:08,520
hey, health insurers are issuing
a lot of denials

350
00:20:08,520 --> 00:20:10,240
<font color="

351
00:20:10,240 --> 00:20:13,840
The people that were in
this facility were getting removed

352
00:20:13,840 --> 00:20:16,560
when they were still very sick
and were not ready to go home.

353
00:20:16,560 --> 00:20:18,120
So, it was just a signal that, OK,

354
00:20:18,120 --> 00:20:20,480
maybe we should ask
some more questions about this.

355
00:20:20,480 --> 00:20:22,960
<font color="
that this all centres around

356
00:20:22,960 --> 00:20:24,800
an algorithm called nH Predict,

357
00:20:24,800 --> 00:20:28,600
and that algorithm is used
on behalf of insurance companies

358
00:20:28,600 --> 00:20:32,080
to reduce the amount of time
that people are in these facilities

359
00:20:32,080 --> 00:20:34,200
and to control their cost of care.

360
00:20:34,200 --> 00:20:36,840
<font color="
the actual algorithm

361
00:20:36,840 --> 00:20:39,200
that's going on underneath this?

362
00:20:39,200 --> 00:20:41,280
Yeah, so there are
a bunch of pieces of data

363
00:20:41,280 --> 00:20:43,360
that they are feeding into a model -

364
00:20:43,360 --> 00:20:46,280
the age of the person,
what was their primary diagnosis,

365
00:20:46,280 --> 00:20:48,120
<font color="

366
00:20:48,120 --> 00:20:52,480
It compares that patient
to other patients like them

367
00:20:52,480 --> 00:20:55,080
in a database of 6 million patients.

368
00:20:55,080 --> 00:20:56,720
And based on this comparison,

369
00:20:56,720 --> 00:20:59,040
this is the amount of care
you should get.

370
00:20:59,040 --> 00:21:00,800
Once that prediction is made,

371
00:21:00,800 --> 00:21:03,280
<font color="
on the calendar,

372
00:21:03,280 --> 00:21:05,600
And this is the date
that they're trained

373
00:21:05,600 --> 00:21:07,680
to push these people toward.

374
00:21:07,680 --> 00:21:10,240
This is the report
that's produced by the algorithm,

375
00:21:10,240 --> 00:21:12,360
and it all boils down to
this prediction,

376
00:21:12,360 --> 00:21:15,240
<font color="
the estimated length of stay

377
00:21:15,240 --> 00:21:18,800
of the patient in this case
is 16.6 days.

378
00:21:18,800 --> 00:21:21,440
.6? Yes. So, it's like to the hour?

379
00:21:21,440 --> 00:21:23,720
It predicts it
down to the decimal point.

380
00:21:23,720 --> 00:21:26,680
You can't predict when somebody's
<font color="

381
00:21:26,680 --> 00:21:28,640
No, and it's the type of information

382
00:21:28,640 --> 00:21:31,600
that only an AI algorithm
could give you.

383
00:21:31,600 --> 00:21:36,320
It doesn't take into account
a lot of things about these people.

384
00:21:36,320 --> 00:21:38,840
Every healthcare journey
is different.

385
00:21:38,840 --> 00:21:40,880
<font color="

386
00:21:40,880 --> 00:21:43,640
everything that comes up
in the course of your care

387
00:21:43,640 --> 00:21:47,800
causes all sorts of things to happen
that can't possibly be predicted.

388
00:21:47,800 --> 00:21:50,400
Literally, they're boiling down
these people to numbers.

389
00:21:50,400 --> 00:21:53,400
"Oh, you're not just a number."
<font color="

390
00:21:53,400 --> 00:21:56,040
There is a counterargument
to all of this, right,

391
00:21:56,040 --> 00:21:58,800
in that people are quite accustomed

392
00:21:58,800 --> 00:22:01,960
to artificial intelligence
that compares you to other people -

393
00:22:01,960 --> 00:22:04,360
like, you know,
the recommendation algorithms

394
00:22:04,360 --> 00:22:06,720
<font color="
or Spotify or Amazon.

395
00:22:06,720 --> 00:22:11,600
It's like, people like you did this.
Therefore, do you want this?

396
00:22:11,600 --> 00:22:13,760
Yeah, and I think
the common experience,

397
00:22:13,760 --> 00:22:16,280
or at least my experience,
is that most of the time,

398
00:22:16,280 --> 00:22:18,680
<font color="
it's way off.

399
00:22:18,680 --> 00:22:21,040
Just because I watched
this cooking show

400
00:22:21,040 --> 00:22:23,240
does not mean I want
to watch this other show.

401
00:22:23,240 --> 00:22:25,400
But if you're talking about me
in the hospital

402
00:22:25,400 --> 00:22:28,480
or after a serious injury
<font color="

403
00:22:28,480 --> 00:22:31,040
well, I have a much bigger problem
with that.

404
00:22:32,640 --> 00:22:37,280
Casey and Bob's damning reporting
concluded in 2024,

405
00:22:37,280 --> 00:22:40,360
throwing UnitedHealthcare
into the spotlight...

406
00:22:41,560 --> 00:22:46,440
..just months before
Brian Thompson was shot dead.

407
00:22:46,440 --> 00:22:49,360
<font color="
about Luigi Mangione?

408
00:22:49,360 --> 00:22:51,320
I remember the morning
that it happened.

409
00:22:51,320 --> 00:22:54,040
We started getting texts from people
and we're like,

410
00:22:54,040 --> 00:22:56,280
"Holy crap.
Is this actually for real?"

411
00:22:56,280 --> 00:22:57,920
We don't have any indication

412
00:22:57,920 --> 00:23:01,560
<font color="
by our reporting,

413
00:23:01,560 --> 00:23:05,040
but nonetheless, as a reporter,
you're stunned, you're shocked.

414
00:23:05,040 --> 00:23:08,680
You don't ever want
any of your reporting

415
00:23:08,680 --> 00:23:11,680
to inspire somebody to act that way.

416
00:23:20,680 --> 00:23:23,000
Luigi Mangione is not someone

417
00:23:23,000 --> 00:23:26,880
<font color="
the role of outlaw vigilante.

418
00:23:30,440 --> 00:23:33,800
He studied at the prestigious
University of Pennsylvania,

419
00:23:33,800 --> 00:23:36,000
one of America's Ivy League.

420
00:23:37,400 --> 00:23:40,760
EMCEE: Luigi Nicholas Mangione.
Luigi.

421
00:23:42,400 --> 00:23:45,640
You can see in this video
<font color="

422
00:23:45,640 --> 00:23:48,840
that Luigi already stood out.

423
00:23:48,840 --> 00:23:53,120
He's giving the valedictorian speech,
which means he's being celebrated

424
00:23:53,120 --> 00:23:57,720
as the most academically successful
student in his year.

425
00:23:57,720 --> 00:24:03,000
Family, friends, faculty
and fellow students, good afternoon.

426
00:24:04,320 --> 00:24:07,800
<font color="
a popular, confident young man.

427
00:24:10,600 --> 00:24:14,120
We spoke to a few of his classmates
who didn't want to go on the record

428
00:24:14,120 --> 00:24:17,480
because they have been continually
hounded by the press ever since,

429
00:24:17,480 --> 00:24:19,200
which you can understand.

430
00:24:19,200 --> 00:24:22,960
And everyone, almost to a point,
<font color="

431
00:24:22,960 --> 00:24:26,000
he was helpful, he was kind,
he was friendly,

432
00:24:26,000 --> 00:24:28,480
he was a popular guy
from a good family

433
00:24:28,480 --> 00:24:30,760
who was also really well educated.

434
00:24:32,120 --> 00:24:36,040
But then I discovered
a remarkable detail about Luigi,

435
00:24:36,040 --> 00:24:38,600
<font color="

436
00:24:40,320 --> 00:24:44,000
He did computer
and information science as his major,

437
00:24:44,000 --> 00:24:50,320
but then he also then got a master's
degree from here in computer science

438
00:24:50,320 --> 00:24:53,320
with a concentration
in artificial intelligence.

439
00:24:54,760 --> 00:24:57,640
One of the modules
<font color="

440
00:24:57,640 --> 00:25:01,560
was exactly the stuff
that sits behind this algorithm.

441
00:25:01,560 --> 00:25:03,560
It's called data structures
and algorithms.

442
00:25:03,560 --> 00:25:07,000
Very meaty,
very mathematical algorithms course

443
00:25:07,000 --> 00:25:10,720
about data structures
<font color="

444
00:25:10,720 --> 00:25:13,840
And the thing is, Luigi wasn't just
doing well in this course.

445
00:25:13,840 --> 00:25:19,080
He was doing so well that he
was appointed as an assistant tutor.

446
00:25:19,080 --> 00:25:21,880
Look at this photo.
I mean, he looks so confident.

447
00:25:22,920 --> 00:25:25,080
He was basically teaching
<font color="

448
00:25:25,080 --> 00:25:27,120
who were the same age as him.

449
00:25:27,120 --> 00:25:30,640
This is stuff that he knew
incredibly well

450
00:25:30,640 --> 00:25:36,400
and, by the sounds of it,
was also very, very good at.

451
00:25:38,280 --> 00:25:43,280
Most of Luigi's friends have
so far refused to go on the record,

452
00:25:43,280 --> 00:25:47,880
<font color="
one person who was willing to talk.

453
00:25:49,000 --> 00:25:51,560
Gurwinder Bhogal is a British blogger

454
00:25:51,560 --> 00:25:55,520
who writes about the impact
of technology on society.

455
00:25:55,520 --> 00:25:58,120
Hi. Hi, Hannah. How are you doing?
Nice to meet you.

456
00:25:58,120 --> 00:26:00,480
<font color="
Thank you for this.

457
00:26:01,920 --> 00:26:05,120
Luigi was a subscriber
to Gurwinder's blog,

458
00:26:05,120 --> 00:26:08,520
and the two of them
talked about their shared concerns.

459
00:26:10,920 --> 00:26:13,600
When I spoke to Luigi,
he was in Japan,

460
00:26:13,600 --> 00:26:18,280
and he was remarking on how sort of
<font color="

461
00:26:18,280 --> 00:26:21,640
The streets were empty
because everything's just automated.

462
00:26:21,640 --> 00:26:25,080
He was quite concerned
about mass automation

463
00:26:25,080 --> 00:26:28,560
and the knock-on effects that
this might be having on society.

464
00:26:28,560 --> 00:26:31,440
You can live your entire life
<font color="

465
00:26:31,440 --> 00:26:33,320
You can do your shopping online,

466
00:26:33,320 --> 00:26:36,760
you can do your banking online,
you can do your dating online.

467
00:26:36,760 --> 00:26:40,080
You can even have
a full relationship online.

468
00:26:40,080 --> 00:26:41,840
There's less human connection

469
00:26:41,840 --> 00:26:44,000
and AI is going to make this
<font color="

470
00:26:44,000 --> 00:26:46,960
I mean, he himself probably
had no problem making friends.

471
00:26:46,960 --> 00:26:48,920
He was a very
charismatic individual,

472
00:26:48,920 --> 00:26:51,360
but I think he was
worried about other people

473
00:26:51,360 --> 00:26:56,360
and maybe how they were
kind of gradually being lost,

474
00:26:56,360 --> 00:26:59,760
<font color="
that keep society together.

475
00:26:59,760 --> 00:27:02,360
And he was worried that
all of that is unravelling.

476
00:27:02,360 --> 00:27:04,760
Did you talk about healthcare
as well?

477
00:27:04,760 --> 00:27:08,160
There was only one brief exchange
that we had.

478
00:27:08,160 --> 00:27:11,600
Luigi made a passing remark
<font color="

479
00:27:11,600 --> 00:27:14,880
because we had the NHS in the UK,
free healthcare.

480
00:27:14,880 --> 00:27:17,320
How did he seem to you?

481
00:27:17,320 --> 00:27:19,840
He actually seemed quite cheerful,

482
00:27:19,840 --> 00:27:24,400
someone who did not seem
particularly pessimistic,

483
00:27:24,400 --> 00:27:28,280
although some of the issues that
<font color="

484
00:27:28,280 --> 00:27:31,080
But his general demeanour
was actually the opposite of that.

485
00:27:31,080 --> 00:27:33,840
He said that he wanted me to focus
less on the problems

486
00:27:33,840 --> 00:27:35,320
and more on the solutions.

487
00:27:35,320 --> 00:27:38,240
He would ask me, "What's
the practical takeaway of this?"

488
00:27:38,240 --> 00:27:41,080
<font color="
interested in moaning.

489
00:27:41,080 --> 00:27:43,560
He wanted to find real solutions.

490
00:27:47,760 --> 00:27:50,920
Since his arrest,
the Luigi Mangione story

491
00:27:50,920 --> 00:27:53,600
had taken on a life of its own...

492
00:27:53,600 --> 00:27:57,960
Luigi Mangione, the internet's
favourite hot Italian sausage.

493
00:27:57,960 --> 00:28:00,680
<font color="
with memes

494
00:28:00,680 --> 00:28:02,480
about the alleged killer.

495
00:28:02,480 --> 00:28:06,240
Luigi,
you're a brave Italian stallion

496
00:28:06,240 --> 00:28:09,600
whose actions ignited
a national dialogue

497
00:28:09,600 --> 00:28:13,880
about the USA's
crappy healthcare system.

498
00:28:13,880 --> 00:28:17,160
<font color="
as I feel about you,

499
00:28:17,160 --> 00:28:20,720
please do not deny,
delay or defend your love.

500
00:28:21,960 --> 00:28:24,320
There was also
no shortage of theories

501
00:28:24,320 --> 00:28:27,200
about what happened and why.

502
00:28:27,200 --> 00:28:30,200
There is a note which was
supposedly found in his backpack

503
00:28:30,200 --> 00:28:31,600
<font color="

504
00:28:31,600 --> 00:28:34,240
and the press have decided
to call this his manifesto.

505
00:28:34,240 --> 00:28:35,760
In the document,

506
00:28:35,760 --> 00:28:39,000
he appeared to talk about
the planning of the alleged crime,

507
00:28:39,000 --> 00:28:42,160
but then moved on
to health insurance.

508
00:28:42,160 --> 00:28:43,920
There's one bit here that says,

509
00:28:43,920 --> 00:28:46,760
<font color="
had it coming."

510
00:28:46,760 --> 00:28:49,760
Then he specifically
name checks United,

511
00:28:49,760 --> 00:28:51,240
and then he says,

512
00:28:51,240 --> 00:28:55,320
"These...indecipherable...have
simply gotten too powerful,

513
00:28:55,320 --> 00:29:00,000
"and they continue to abuse
our country for immense profit

514
00:29:00,000 --> 00:29:04,600
<font color="
allowed them to get away with it."

515
00:29:04,600 --> 00:29:07,880
The other thing that
the internet is obsessed with

516
00:29:07,880 --> 00:29:09,720
is his own personal story.

517
00:29:09,720 --> 00:29:14,920
It's how he ended up feeling so
strongly about this particular issue.

518
00:29:14,920 --> 00:29:17,320
I've got his X profile.

519
00:29:17,320 --> 00:29:21,720
<font color="
he's got this X-ray...

520
00:29:21,720 --> 00:29:24,040
..and we know that
he had a spinal problem.

521
00:29:24,040 --> 00:29:25,960
We know that he had surgery for it.

522
00:29:25,960 --> 00:29:29,840
And that's...I mean,
that's pretty extreme, that surgery.

523
00:29:29,840 --> 00:29:33,800
But what is interesting
<font color="

524
00:29:33,800 --> 00:29:36,880
that he was actually a client
of UnitedHealthcare.

525
00:29:36,880 --> 00:29:39,240
And so far,
nobody's found anything to prove

526
00:29:39,240 --> 00:29:42,320
that he had a personal
insurance claim denied even.

527
00:29:45,920 --> 00:29:50,400
As humans, we understand
<font color="

528
00:29:50,400 --> 00:29:53,520
Real doctors often
don't have all the answers,

529
00:29:53,520 --> 00:29:57,040
but we forgive them
for their very human flaws.

530
00:29:58,800 --> 00:30:01,000
But when it comes to technology,

531
00:30:01,000 --> 00:30:03,880
we have
very little tolerance for error.

532
00:30:05,080 --> 00:30:07,800
The flipside is also true -

533
00:30:07,800 --> 00:30:11,960
<font color="
extraordinary medical possibilities,

534
00:30:11,960 --> 00:30:15,560
it's all too easy for us
to believe in the impossible.

535
00:30:24,240 --> 00:30:27,000
Just a few miles
across the state line,

536
00:30:27,000 --> 00:30:30,000
I've been invited to meet
a young tech entrepreneur

537
00:30:30,000 --> 00:30:33,840
<font color="
new medical breakthrough...

538
00:30:33,840 --> 00:30:35,240
Hey! Hey!

539
00:30:35,240 --> 00:30:36,680
..using AI.

540
00:30:36,680 --> 00:30:38,240
How are you? Yeah, very good.

541
00:30:38,240 --> 00:30:40,560
25-year-old Kian Sadeghi

542
00:30:40,560 --> 00:30:44,320
runs a tech start-up
called Nucleus Genomics.

543
00:30:44,320 --> 00:30:47,720
<font color="
the entire genome? The entire thing.

544
00:30:47,720 --> 00:30:49,600
The whole thing? The whole thing.

545
00:30:51,320 --> 00:30:55,040
His company uses AI algorithms
to analyse the DNA

546
00:30:55,040 --> 00:30:59,520
of his customers' future children
like never before.

547
00:30:59,520 --> 00:31:01,880
<font color="
Yes.

548
00:31:02,920 --> 00:31:06,120
How many embryos do you reckon
there are in here? Like millions?

549
00:31:06,120 --> 00:31:08,200
If all the samples here
were embryos,

550
00:31:08,200 --> 00:31:10,360
yes, there would be millions, yes.

551
00:31:10,360 --> 00:31:13,280
Millions of potential new humans.
Yeah.

552
00:31:14,800 --> 00:31:18,560
<font color="
to map each embryo's DNA,

553
00:31:18,560 --> 00:31:21,240
comparing it against
huge DNA databases

554
00:31:21,240 --> 00:31:25,000
to try to predict
a baby's future risk of disease.

555
00:31:26,120 --> 00:31:29,200
Some diseases can be predicted
with certainty.

556
00:31:29,200 --> 00:31:33,280
For others, he can say how people
<font color="

557
00:31:34,240 --> 00:31:38,040
When I talk to a couple, they say,
"My grandfather had Alzheimer's.

558
00:31:38,040 --> 00:31:39,400
"I want to do anything I can

559
00:31:39,400 --> 00:31:41,720
"to make sure
my son doesn't have Alzheimer's."

560
00:31:41,720 --> 00:31:44,560
And then I think, well, genetics
obviously can help with that.

561
00:31:44,560 --> 00:31:46,640
<font color="
are going to use IVF

562
00:31:46,640 --> 00:31:49,960
and they're going to be using
genetic optimisation technology

563
00:31:49,960 --> 00:31:51,880
to basically pick their child.

564
00:31:52,920 --> 00:31:56,720
Figuring out whether a baby will
develop Alzheimer's later in life

565
00:31:56,720 --> 00:32:00,080
is a best guess, not a diagnosis.

566
00:32:00,080 --> 00:32:04,040
<font color="
helping parents choose an embryo

567
00:32:04,040 --> 00:32:07,760
based on eye colour,
height or even IQ.

568
00:32:08,840 --> 00:32:11,520
Welcome to the Nucleus office.
Thank you.

569
00:32:11,520 --> 00:32:15,680
Kian had already raised $32 million
from investors.

570
00:32:15,680 --> 00:32:17,960
By the way,
<font color="

571
00:32:17,960 --> 00:32:19,440
on the right side of the screen,

572
00:32:19,440 --> 00:32:21,720
I don't think you should ever
show that on the camera

573
00:32:21,720 --> 00:32:23,160
cos it is actually so insane.

574
00:32:23,160 --> 00:32:26,120
I think it also slows down.
I think it uses up your RAM.

575
00:32:26,120 --> 00:32:28,200
Anyways, let me show you this.

576
00:32:28,200 --> 00:32:30,880
<font color="
a glossy new ad campaign.

577
00:32:30,880 --> 00:32:33,080
I think it is. OK, let's go.

578
00:32:33,080 --> 00:32:36,520
Nucleus Embryo is
for couples doing IVF

579
00:32:36,520 --> 00:32:40,640
to uncover the full genetic profile
of each embryo

580
00:32:40,640 --> 00:32:43,760
in one intuitive platform.

581
00:32:43,760 --> 00:32:47,160
Every parent deserves
<font color="

582
00:32:47,160 --> 00:32:51,200
what possibility feels right
for their family.

583
00:32:51,200 --> 00:32:55,080
Some people don't think
you should have this choice.

584
00:33:00,240 --> 00:33:02,760
You're not afraid of controversy,
are you?

585
00:33:02,760 --> 00:33:06,560
KIAN LAUGHS

586
00:33:02,760 --> 00:33:06,560
No, no, no. It's not... It's...

587
00:33:06,560 --> 00:33:10,400
<font color="
and you had five embryos,

588
00:33:10,400 --> 00:33:13,000
would you want to pick
your future baby randomly,

589
00:33:13,000 --> 00:33:15,880
or would you ask the doctor
for more information on each,

590
00:33:15,880 --> 00:33:19,400
especially if you have a family
history of Alzheimer's, of cancer?

591
00:33:19,400 --> 00:33:21,240
<font color="
to know this information.

592
00:33:21,240 --> 00:33:23,760
It's my choice to say I want a baby
with lower disease risk,

593
00:33:23,760 --> 00:33:25,400
a baby that's slightly taller

594
00:33:25,400 --> 00:33:27,280
or even with a specific eye colour,
etc.

595
00:33:27,280 --> 00:33:28,960
It's their right, it's their choice.

596
00:33:28,960 --> 00:33:30,920
<font color="
where people have

597
00:33:30,920 --> 00:33:33,160
genetic predispositions
for particular diseases,

598
00:33:33,160 --> 00:33:36,480
especially when they're preventable
or treatable, it is amazing.

599
00:33:36,480 --> 00:33:39,320
What I don't understand
is why you would include

600
00:33:39,320 --> 00:33:41,640
<font color="

601
00:33:41,640 --> 00:33:45,680
cos it's so controversial
and it's a little bit eugenics-y.

602
00:33:45,680 --> 00:33:49,360
You know, you are implicitly saying
that taller is better.

603
00:33:49,360 --> 00:33:53,120
You are reinforcing the ideas
of preferences

604
00:33:53,120 --> 00:33:55,640
that some people
<font color="

605
00:33:56,640 --> 00:33:58,160
No, not at all.

606
00:33:58,160 --> 00:34:03,640
I think parents have the right to
choose across their embryos, right?

607
00:34:03,640 --> 00:34:06,560
If they want a baby with
a lower disease risk, for example,

608
00:34:06,560 --> 00:34:08,720
or if they want a baby
that's shorter or taller,

609
00:34:08,720 --> 00:34:10,480
<font color="
to choose.

610
00:34:10,480 --> 00:34:13,320
This is designer babies, though.
Bluntly, this is designer babies.

611
00:34:13,320 --> 00:34:15,440
No, it's not designer babies
at all, actually.

612
00:34:15,440 --> 00:34:17,160
How is it not? It's not at all.

613
00:34:17,160 --> 00:34:20,240
If a parent wants to give
<font color="

614
00:34:20,240 --> 00:34:25,360
that is like a parent doing the most
basic, in my mind, and human thing.

615
00:34:25,360 --> 00:34:26,920
If a parent...

616
00:34:26,920 --> 00:34:28,600
The moment a child's born,

617
00:34:28,600 --> 00:34:31,120
they will run multiple tests
on a baby

618
00:34:31,120 --> 00:34:32,560
to make sure the baby's healthy.

619
00:34:32,560 --> 00:34:34,280
<font color="
for example,

620
00:34:34,280 --> 00:34:35,920
to make sure
they don't get diseases.

621
00:34:35,920 --> 00:34:39,280
This is just another tool in the
toolkit that helps parents do that.

622
00:34:40,800 --> 00:34:43,520
But there was something else
I was worried about.

623
00:34:43,520 --> 00:34:46,320
Even the best scientists
<font color="

624
00:34:46,320 --> 00:34:50,920
how genes and environment combine
to make us who we are.

625
00:34:50,920 --> 00:34:54,680
I was worried that all of
this complexity was being overlooked

626
00:34:54,680 --> 00:34:59,720
in favour of
tantalisingly simple AI predictions.

627
00:34:59,720 --> 00:35:05,760
Do you think that
<font color="

628
00:35:05,760 --> 00:35:08,880
accurate enough, capable enough,

629
00:35:08,880 --> 00:35:12,720
to be giving people this illusion
that they have control?

630
00:35:12,720 --> 00:35:15,040
The platform, I think,
does an excellent job

631
00:35:15,040 --> 00:35:18,160
showing the uncertainty
and showing the fact that, again,

632
00:35:18,160 --> 00:35:21,000
<font color="
and DNA will never be destiny.

633
00:35:21,000 --> 00:35:23,280
People can have
certain just genetic dispositions,

634
00:35:23,280 --> 00:35:25,320
but there's
the whole thing called life.

635
00:35:25,320 --> 00:35:27,840
There's environment,
there's how you're nurtured,

636
00:35:27,840 --> 00:35:30,040
how you're raised, nutrition, etc.

637
00:35:30,040 --> 00:35:34,560
<font color="
to just a DNA strand.

638
00:35:40,440 --> 00:35:44,600
Testing for physical characteristics
is banned in the UK,

639
00:35:44,600 --> 00:35:49,120
but there's nothing to stop British
couples travelling to the US for it,

640
00:35:49,120 --> 00:35:53,680
as long as they're willing to pay
the approximate $40,000 price tag.

641
00:35:53,680 --> 00:35:55,560
<font color="

642
00:35:57,800 --> 00:36:01,840
Hi! How are you doing?
Hello, welcome. Thank you.

643
00:36:01,840 --> 00:36:04,680
Dragos and Laura live in London,

644
00:36:04,680 --> 00:36:08,200
and were at the start of their
IVF journey with Kian's company.

645
00:36:09,400 --> 00:36:12,040
These are beautiful.
Are these your babies?

646
00:36:12,040 --> 00:36:15,280
<font color="

647
00:36:15,280 --> 00:36:18,040
So, your two boys,
did you have them naturally?

648
00:36:18,040 --> 00:36:19,480
Yes, we did.

649
00:36:19,480 --> 00:36:21,840
So, why not naturally for the third?

650
00:36:21,840 --> 00:36:24,360
Because Dragos was kind of afraid.

651
00:36:24,360 --> 00:36:27,320
We are... I'm 40, he's 43.

652
00:36:27,320 --> 00:36:29,160
When you're over 43,

653
00:36:29,160 --> 00:36:33,560
<font color="
of having issues are very high.

654
00:36:33,560 --> 00:36:35,160
If this wasn't possible,

655
00:36:35,160 --> 00:36:38,080
would you still want
to have another baby?

656
00:36:38,080 --> 00:36:41,000
Definitely not. Not? Not.

657
00:36:41,000 --> 00:36:43,240
Because you don't want to
take chances.

658
00:36:43,240 --> 00:36:46,000
<font color="
a healthy child is,

659
00:36:46,000 --> 00:36:50,800
and I think everybody should
do the extra mile for that outcome.

660
00:36:50,800 --> 00:36:53,480
Where are you at now, then,
in the process?

661
00:36:53,480 --> 00:36:55,720
In less than two months,

662
00:36:55,720 --> 00:37:00,560
we are going to New York
<font color="

663
00:37:00,560 --> 00:37:03,400
And then they will test the egg.
They will take few cells.

664
00:37:03,400 --> 00:37:06,520
They will zoom in on anything
that can happen.

665
00:37:06,520 --> 00:37:09,040
And then once we have selected
the right embryo,

666
00:37:09,040 --> 00:37:11,680
then we would go back to New York
<font color="

667
00:37:11,680 --> 00:37:13,680
which takes only one or two days.

668
00:37:13,680 --> 00:37:18,440
So, in theory, in a few months,
you could be pregnant.

669
00:37:18,440 --> 00:37:20,320
Yes. Fingers crossed.

670
00:37:20,320 --> 00:37:21,920
Thank you. Yeah.

671
00:37:21,920 --> 00:37:26,000
We both want a healthy child,
a healthy embryo.

672
00:37:27,160 --> 00:37:30,480
<font color="
she's going to be a girl.

673
00:37:30,480 --> 00:37:31,840
SHE CHUCKLES

674
00:37:31,840 --> 00:37:34,720
Is that the dream, a little girl?
Yes.

675
00:37:34,720 --> 00:37:38,040
This was my dream all along,
to have three babies.

676
00:37:38,040 --> 00:37:44,440
So, if a girl would come, would be
the perfect picture for myself.

677
00:37:44,440 --> 00:37:46,080
<font color="

678
00:37:46,080 --> 00:37:48,080
or your potential daughter
in your head,

679
00:37:48,080 --> 00:37:49,600
what does she look like?

680
00:37:51,600 --> 00:37:53,080
Beautiful.

681
00:37:54,720 --> 00:37:58,680
Um... Brown eyes, brown hair.

682
00:37:58,680 --> 00:38:02,640
Light skin. Big lips, full lips.

683
00:38:02,640 --> 00:38:04,960
LAUGHING: I don't know.

684
00:38:04,960 --> 00:38:06,760
<font color="

685
00:38:06,760 --> 00:38:08,560
BOTH LAUGH

686
00:38:06,760 --> 00:38:08,560
Not like me!

687
00:38:09,920 --> 00:38:14,240
Hopefully not bald...with a beard.

688
00:38:14,240 --> 00:38:16,640
Some people worry about
the Nucleus stuff

689
00:38:16,640 --> 00:38:20,800
because it effectively prioritises

690
00:38:20,800 --> 00:38:23,760
some characteristics of the baby
over others.

691
00:38:23,760 --> 00:38:28,360
<font color="
height is stuff that you can,

692
00:38:28,360 --> 00:38:30,960
in theory, at least give
a probability to, right?

693
00:38:30,960 --> 00:38:32,360
You can measure.

694
00:38:32,360 --> 00:38:36,600
I would not go through this just
for the height and the eye colour,

695
00:38:36,600 --> 00:38:39,520
but if height is
<font color="

696
00:38:39,520 --> 00:38:41,080
maybe it's important, maybe not.

697
00:38:41,080 --> 00:38:45,480
But, you know, we'll take that
because it's on the table.

698
00:38:45,480 --> 00:38:50,720
They give you a probability
of the IQ that he or she might have.

699
00:38:50,720 --> 00:38:52,360
Um... But, yes.

700
00:38:52,360 --> 00:38:55,160
And that's going to be one
<font color="

701
00:38:55,160 --> 00:38:57,960
SHE LAUGHS

702
00:38:55,160 --> 00:38:57,960
Of course we will.

703
00:38:57,960 --> 00:39:01,160
Before Dragos and Laura
started their IVF cycle,

704
00:39:01,160 --> 00:39:03,280
there was a first step -

705
00:39:03,280 --> 00:39:06,600
getting their own DNA mapped
by Nucleus...

706
00:39:06,600 --> 00:39:08,040
I don't know, let's see.

707
00:39:08,040 --> 00:39:10,440
<font color="
for any diseases

708
00:39:10,440 --> 00:39:13,080
they could pass on to their baby.

709
00:39:13,080 --> 00:39:16,040
The results of these genetic tests
had just come in.

710
00:39:17,400 --> 00:39:19,120
The moment of truth.

711
00:39:22,000 --> 00:39:24,080
Feels like unravelling a present.

712
00:39:24,080 --> 00:39:25,960
You don't know
exactly what's inside.

713
00:39:29,720 --> 00:39:32,080
<font color="

714
00:39:33,280 --> 00:39:38,360
We have 2,154 rare diseases tested

715
00:39:38,360 --> 00:39:40,800
and one detected risk for children.

716
00:39:40,800 --> 00:39:44,640
Fuchs endothelial corneal dystrophy.

717
00:39:44,640 --> 00:39:46,960
Symptoms often begin at 50.

718
00:39:46,960 --> 00:39:49,960
So, imagine our child
is born this year.

719
00:39:49,960 --> 00:39:54,320
50 years from now,
<font color="

720
00:39:54,320 --> 00:39:56,520
that we can replace
hard-wired to our brain.

721
00:39:56,520 --> 00:39:59,360
So I don't think
this is serious enough

722
00:39:59,360 --> 00:40:01,360
for us to be worried about it.

723
00:40:01,360 --> 00:40:04,040
Of all of the things
that could potentially be risky -

724
00:40:04,040 --> 00:40:06,400
Alzheimer's, Parkinson's,
<font color="

725
00:40:06,400 --> 00:40:09,920
Yeah, this is very... Low level.
Low level, mild.

726
00:40:11,000 --> 00:40:15,280
"Don't worry. You and Laura
can still have healthy children."

727
00:40:16,640 --> 00:40:19,600
So, I think this is important. Mm.

728
00:40:23,800 --> 00:40:26,840
I think if you're having a baby
<font color="

729
00:40:26,840 --> 00:40:28,760
I can completely understand

730
00:40:28,760 --> 00:40:31,440
why you would want
as much information as possible.

731
00:40:31,440 --> 00:40:35,360
If you are prone to worry,

732
00:40:35,360 --> 00:40:41,200
why wouldn't you try and eliminate
the risks where you possibly can?

733
00:40:41,200 --> 00:40:43,040
But at the same time,

734
00:40:43,040 --> 00:40:48,400
I'm worried that
<font color="

735
00:40:48,400 --> 00:40:52,160
gives the illusion of control
that you don't actually have.

736
00:40:53,520 --> 00:40:56,240
Gives the illusion of certainty

737
00:40:56,240 --> 00:41:02,400
and a prediction of the future
that doesn't really exist.

738
00:41:13,800 --> 00:41:15,400
Over in the US,

739
00:41:15,400 --> 00:41:18,560
Luigi's case had proceeded
<font color="

740
00:41:18,560 --> 00:41:20,640
Charged with murder
in the first degree,

741
00:41:20,640 --> 00:41:24,720
killing as an act of terrorism and
criminal possession of a weapon,

742
00:41:24,720 --> 00:41:26,520
he faced his plea hearing...

743
00:41:32,360 --> 00:41:35,480
..stoking further outrage
on both sides.

744
00:41:35,480 --> 00:41:37,320
<font color="

745
00:41:37,320 --> 00:41:39,440
Healthcare is a human right!

746
00:41:39,440 --> 00:41:42,880
We have very disturbed people
who somehow think

747
00:41:42,880 --> 00:41:46,080
that eliminating a father
who has two young children

748
00:41:46,080 --> 00:41:49,040
over some cause
is somehow justified.

749
00:41:52,320 --> 00:41:54,360
<font color="

750
00:41:54,360 --> 00:41:58,760
another legal case was
quietly gaining its own momentum.

751
00:42:04,360 --> 00:42:09,120
A class action lawsuit against
UnitedHealthcare's use of AI

752
00:42:09,120 --> 00:42:12,880
had been launched
by one plucky public interest firm

753
00:42:12,880 --> 00:42:14,840
called Clarkson Law.

754
00:42:16,120 --> 00:42:19,160
<font color="
against other big insurers

755
00:42:19,160 --> 00:42:20,960
for similar claims.

756
00:42:20,960 --> 00:42:24,040
Lawyer Glenn Danas
is leading the charge.

757
00:42:25,360 --> 00:42:29,600
We know for sure that
there is an algorithm of some kind

758
00:42:29,600 --> 00:42:33,200
that is predicting how long you need
in rehabilitation,

759
00:42:33,200 --> 00:42:38,240
<font color="
think that wasn't long enough.

760
00:42:38,240 --> 00:42:40,120
Is that fair? Yes.

761
00:42:40,120 --> 00:42:43,280
I mean, from our perspective,
that's a vast understatement.

762
00:42:43,280 --> 00:42:45,560
but that is in fact true, yes.

763
00:42:45,560 --> 00:42:49,960
The length of stay value
is consistently too low,

764
00:42:49,960 --> 00:42:53,960
<font color="
that this is an accident

765
00:42:53,960 --> 00:42:56,400
because it's only ever
in one direction.

766
00:42:56,400 --> 00:42:58,280
How does the legal case come in?

767
00:42:58,280 --> 00:42:59,720
One way it's illegal

768
00:42:59,720 --> 00:43:02,280
is because there are
different states like California

769
00:43:02,280 --> 00:43:05,960
<font color="
making decisions,

770
00:43:05,960 --> 00:43:11,960
so that by law it cannot be
delegated to an AI, an algorithm,

771
00:43:11,960 --> 00:43:15,160
anything other than
a human medical professional

772
00:43:15,160 --> 00:43:19,880
exercising his or her professional
knowledge and specialty.

773
00:43:22,640 --> 00:43:26,160
<font color="
How many plaintiffs are there?

774
00:43:26,160 --> 00:43:29,760
Because United has such
a large market share in America,

775
00:43:29,760 --> 00:43:32,400
it's almost certainly in millions.

776
00:43:33,840 --> 00:43:36,240
If you eventually win this case,

777
00:43:36,240 --> 00:43:39,120
does that mean that
they have to compensate everybody

778
00:43:39,120 --> 00:43:40,880
<font color="

779
00:43:40,880 --> 00:43:44,960
What we want, whether it's by
a settlement or by going to trial,

780
00:43:44,960 --> 00:43:47,560
is to have all the people
who were denied

781
00:43:47,560 --> 00:43:50,240
what was owed to them
to be paid for that,

782
00:43:50,240 --> 00:43:53,360
and then to change these practices
<font color="

783
00:43:56,320 --> 00:43:58,560
The Clarkson case
rests on the evidence

784
00:43:58,560 --> 00:44:04,160
of former UnitedHealthcare customers
who have come forward to testify,

785
00:44:04,160 --> 00:44:08,160
and in particular, those who
have survived to tell their tale.

786
00:44:08,160 --> 00:44:10,840
Hey. Bill, this is Hannah.

787
00:44:10,840 --> 00:44:13,160
<font color="

788
00:44:13,160 --> 00:44:16,200
How are you doing? Very good,
thank you. Lovely to meet you.

789
00:44:16,200 --> 00:44:19,280
One of those is
86-year-old Bill Hull.

790
00:44:20,320 --> 00:44:24,040
How are you guys doing? Well,
<font color="

791
00:44:25,520 --> 00:44:28,200
Your koi are quite the beasts.

792
00:44:28,200 --> 00:44:29,680
Can I chuck them in?

793
00:44:31,240 --> 00:44:34,640
So, tell me, how are you doing now?
How's your health at the moment?

794
00:44:34,640 --> 00:44:39,000
About 70% of my heart is shot. Mm.

795
00:44:39,000 --> 00:44:45,040
But the worst part has been the
<font color="

796
00:44:45,040 --> 00:44:47,560
I used to be very active. Mm.

797
00:44:47,560 --> 00:44:51,880
We did this thing,
did all the bricking here.

798
00:44:51,880 --> 00:44:54,800
Can't do any of that any more.

799
00:44:54,800 --> 00:44:57,640
In June 2023,
he suffered a heart attack

800
00:44:57,640 --> 00:45:00,480
on his way to a medical appointment.

801
00:45:00,480 --> 00:45:02,040
<font color="

802
00:45:02,040 --> 00:45:04,800
big, long park bench
just outside the building.

803
00:45:04,800 --> 00:45:06,720
I just slumped over, apparently.

804
00:45:06,720 --> 00:45:11,600
Two medical technicians that knew
CPR laid me down on the bench

805
00:45:11,600 --> 00:45:15,280
and they broke all my ribs,
and I understood later,

806
00:45:15,280 --> 00:45:18,640
<font color="
you ain't doing it right. Wow.

807
00:45:18,640 --> 00:45:21,560
I was in the hospital for 25 days.

808
00:45:21,560 --> 00:45:23,120
In intensive care?

809
00:45:23,120 --> 00:45:25,240
Almost all of it was intensive.

810
00:45:25,240 --> 00:45:29,000
I'm there, and I think on
the 22nd or 23rd day,

811
00:45:29,000 --> 00:45:32,200
I got a notice that,
<font color="

812
00:45:32,200 --> 00:45:35,960
They said, "Well, we'll assign
a case manager to you."

813
00:45:35,960 --> 00:45:39,440
She got ahold of me and said,
"I have talked with your doctors,

814
00:45:39,440 --> 00:45:43,560
"and everyone recommends
that you go into skilled nursing."

815
00:45:43,560 --> 00:45:48,280
A day later, she came back and said,
<font color="

816
00:45:48,280 --> 00:45:52,040
They would not approve it
and wouldn't give me a reason.

817
00:45:52,040 --> 00:45:55,120
Clarkson Law argued
that this denial was likely

818
00:45:55,120 --> 00:45:59,600
the result of
UnitedHealthcare's Predict algorithm.

819
00:45:59,600 --> 00:46:02,200
They made you feel like
<font color="

820
00:46:02,200 --> 00:46:04,360
and yet they were giving you
no place to go.

821
00:46:04,360 --> 00:46:06,040
They said,
"Where do you want to go?"

822
00:46:06,040 --> 00:46:07,960
I said, "I guess I'm going to
go home."

823
00:46:07,960 --> 00:46:11,400
"OK, we'll get you out of here."
Stuck me in the car.

824
00:46:11,400 --> 00:46:14,160
<font color="
were you in at this point?

825
00:46:14,160 --> 00:46:15,880
My wife was very worried

826
00:46:15,880 --> 00:46:19,000
because she didn't know
if she could take care of me.

827
00:46:19,000 --> 00:46:20,640
She's 85 years old.

828
00:46:20,640 --> 00:46:23,760
She has macular degeneration,
has a hard time seeing.

829
00:46:23,760 --> 00:46:27,160
She's using a walker, too,
<font color="

830
00:46:27,160 --> 00:46:29,160
Anyway, I get home.

831
00:46:29,160 --> 00:46:33,000
I was two and a half,
three days out of the hospital.

832
00:46:33,000 --> 00:46:36,600
My daughter came over
and I was in bad shape,

833
00:46:36,600 --> 00:46:38,520
I think slurring my words.

834
00:46:38,520 --> 00:46:40,920
I was starting to have a stroke.

835
00:46:40,920 --> 00:46:43,400
I could not move a finger,
<font color="

836
00:46:43,400 --> 00:46:45,080
couldn't move my foot.

837
00:46:45,080 --> 00:46:48,400
You feel yourself
just literally dying.

838
00:46:48,400 --> 00:46:50,120
That's terrifying.

839
00:46:50,120 --> 00:46:52,560
Oh, worst thing
that ever happened to me.

840
00:46:53,960 --> 00:46:57,600
Do you think that
you would have had the stroke

841
00:46:57,600 --> 00:46:59,880
<font color="

842
00:46:59,880 --> 00:47:02,040
Well, I think
I'd have had the stroke,

843
00:47:02,040 --> 00:47:07,720
but I should have been in either a
skilled nursing or in the hospital.

844
00:47:07,720 --> 00:47:11,880
I'd have gotten some attention
several hours before,

845
00:47:11,880 --> 00:47:13,440
and what I ended up with

846
00:47:13,440 --> 00:47:16,040
<font color="
what I ended up with.

847
00:47:20,600 --> 00:47:25,000
Bill is now looked after
by his daughters, Lisa and Laura.

848
00:47:25,000 --> 00:47:27,360
What's your take on
artificial intelligence

849
00:47:27,360 --> 00:47:29,240
being used in your dad's healthcare?

850
00:47:29,240 --> 00:47:31,560
Certainly, the whole time
<font color="

851
00:47:31,560 --> 00:47:37,360
we assumed it was
doctors who worked for that hospital

852
00:47:37,360 --> 00:47:41,440
who were making these decisions
and who were denying this care.

853
00:47:41,440 --> 00:47:44,840
And it wasn't until he found
the class action lawsuit

854
00:47:44,840 --> 00:47:48,920
that he believed
<font color="

855
00:47:48,920 --> 00:47:51,560
that was being utilised
by UnitedHealthcare.

856
00:47:51,560 --> 00:47:53,760
I guess if a human had been
making that decision,

857
00:47:53,760 --> 00:47:56,720
you'd able to have a conversation
with them. You would think.

858
00:47:56,720 --> 00:48:00,000
If an algorithm says it, you can
<font color="

859
00:48:00,000 --> 00:48:01,880
I feel like that's
what they're doing.

860
00:48:01,880 --> 00:48:03,840
If they can make AI
do their dirty work,

861
00:48:03,840 --> 00:48:06,400
I think they're very happy
to do that.

862
00:48:06,400 --> 00:48:08,880
How do you feel about the murder of
Brian Thompson?

863
00:48:08,880 --> 00:48:15,160
<font color="
frustrated human beings can become

864
00:48:15,160 --> 00:48:18,280
with huge corporations
like UnitedHealthcare.

865
00:48:18,280 --> 00:48:21,720
But I 100% don't condone
what happened

866
00:48:21,720 --> 00:48:25,520
and wouldn't condone
any action like that in the future,

867
00:48:25,520 --> 00:48:30,840
<font color="
and it's justified.

868
00:48:35,360 --> 00:48:40,600
The thing is, I'm not anti-AI, right.
I'm not anti-algorithms.

869
00:48:40,600 --> 00:48:44,480
I think that there is
an incredible amount of waste

870
00:48:44,480 --> 00:48:46,720
that happens
when humans make decisions.

871
00:48:46,720 --> 00:48:49,080
I think
<font color="

872
00:48:49,080 --> 00:48:52,280
and therefore better care
that you can provide people

873
00:48:52,280 --> 00:48:55,160
when you carefully introduce
these kind of systems.

874
00:48:56,560 --> 00:48:59,760
The problem is that
once you start automating stuff,

875
00:48:59,760 --> 00:49:02,880
it all comes down to
<font color="

876
00:49:02,880 --> 00:49:04,920
was designed to care about.

877
00:49:04,920 --> 00:49:08,080
You know,
was it designed to care about

878
00:49:08,080 --> 00:49:12,080
improving the outcomes
for the patients in the long term,

879
00:49:12,080 --> 00:49:17,240
or was it designed to minimise
the amount of money

880
00:49:17,240 --> 00:49:19,880
that is spent on
<font color="

881
00:49:19,880 --> 00:49:22,160
And those are two things that are...

882
00:49:24,800 --> 00:49:27,080
..often at odds with one another.

883
00:49:31,040 --> 00:49:34,120
But the problems with algorithms
go deeper.

884
00:49:37,440 --> 00:49:40,840
Here is one thing
that you should know about AI.

885
00:49:40,840 --> 00:49:45,600
Sometimes people call it a black box,
<font color="

886
00:49:45,600 --> 00:49:47,680
You have to imagine that at one end,

887
00:49:47,680 --> 00:49:50,720
you're putting in some information -
your input -

888
00:49:50,720 --> 00:49:54,440
and at the other end,
you get some results - your output.

889
00:49:54,440 --> 00:49:56,120
Now, the question is,

890
00:49:56,120 --> 00:50:00,680
what is going on in the middle
<font color="

891
00:50:00,680 --> 00:50:04,000
Now, there is nothing magical
going on here. There's no voodoo.

892
00:50:04,000 --> 00:50:07,240
It's just loads and loads
and loads of calculations.

893
00:50:07,240 --> 00:50:11,960
But these things are so big
and unwieldy

894
00:50:11,960 --> 00:50:14,840
that it becomes impossible
<font color="

895
00:50:14,840 --> 00:50:17,880
from one end
all the way through to the other.

896
00:50:17,880 --> 00:50:21,080
And that means
that artificial intelligence

897
00:50:21,080 --> 00:50:25,160
is sometimes finding patterns
that we cannot see,

898
00:50:25,160 --> 00:50:29,120
are unable to check
and might not like.

899
00:50:30,600 --> 00:50:34,520
<font color="

900
00:50:34,520 --> 00:50:37,120
by a researcher
called Ziad Obermeyer.

901
00:50:38,160 --> 00:50:42,000
He looked at an AI algorithm
being used in hospitals

902
00:50:42,000 --> 00:50:45,240
to identify patients
most in need of care

903
00:50:45,240 --> 00:50:48,120
and offer them help
on a special programme.

904
00:50:49,600 --> 00:50:52,960
<font color="
the algorithm selected

905
00:50:52,960 --> 00:50:55,800
were disproportionately white.

906
00:50:55,800 --> 00:50:58,920
These algorithms should have been
a great use case for AI,

907
00:50:58,920 --> 00:51:02,400
but unfortunately, a design choice
in building those algorithms

908
00:51:02,400 --> 00:51:04,160
made them biased.

909
00:51:04,160 --> 00:51:07,160
<font color="

910
00:51:07,160 --> 00:51:10,080
so he worked backwards
from the results

911
00:51:10,080 --> 00:51:13,360
and found that the algorithm
had used a short cut.

912
00:51:13,360 --> 00:51:15,880
It wasn't finding
the sickest patients,

913
00:51:15,880 --> 00:51:20,400
it was finding the ones who'd had
<font color="

914
00:51:21,560 --> 00:51:24,040
Black patients have
less money spent on them

915
00:51:24,040 --> 00:51:25,640
by our healthcare system today

916
00:51:25,640 --> 00:51:28,960
because of barriers to access
and because of discrimination.

917
00:51:28,960 --> 00:51:32,200
And that means that
the AI saw that fact clearly.

918
00:51:32,200 --> 00:51:34,160
<font color="

919
00:51:34,160 --> 00:51:36,480
But instead of undoing
that inequality,

920
00:51:36,480 --> 00:51:39,400
it reinforced it
and enshrined it in policy.

921
00:51:40,560 --> 00:51:44,040
Even though the objective of
the algorithm was good,

922
00:51:44,040 --> 00:51:46,840
the outcome led to discrimination,

923
00:51:46,840 --> 00:51:52,000
<font color="
been there to spot the difference.

924
00:51:59,040 --> 00:52:02,360
We may never be able to see
inside the algorithm

925
00:52:02,360 --> 00:52:06,160
used by UnitedHealthcare
to assess claims.

926
00:52:06,160 --> 00:52:11,160
The closest we can get is by talking
to those who worked alongside it.

927
00:52:11,160 --> 00:52:13,800
<font color="
very few company insiders

928
00:52:13,800 --> 00:52:16,960
have ever spoken
on the record about this AI,

929
00:52:16,960 --> 00:52:20,200
but one former employee
had agreed to meet me.

930
00:52:21,880 --> 00:52:25,040
Lovely to meet you.
Would you like something to drink?

931
00:52:25,040 --> 00:52:28,080
Thank you so much.
<font color="

932
00:52:28,080 --> 00:52:30,400
Amber Lynch was a care coordinator,

933
00:52:30,400 --> 00:52:34,200
responsible for entering patient data
into the algorithm

934
00:52:34,200 --> 00:52:36,920
and ensuring
they were discharged on time.

935
00:52:37,960 --> 00:52:40,760
So, tell me your background, then.
What did you train as?

936
00:52:40,760 --> 00:52:43,400
<font color="
I'm an occupational therapist.

937
00:52:43,400 --> 00:52:47,640
20 years I was working in clinics,
in hospitals.

938
00:52:47,640 --> 00:52:50,200
I actually did home health,
so I went to their home.

939
00:52:50,200 --> 00:52:52,200
I did it all, basically.

940
00:52:52,200 --> 00:52:56,200
And then I had the opportunity
to go nonclinical.

941
00:52:56,200 --> 00:52:58,200
<font color="

942
00:52:58,200 --> 00:53:00,000
Well, when I got a new case,

943
00:53:00,000 --> 00:53:03,960
I was given doctor's notes,
I was given admission notes,

944
00:53:03,960 --> 00:53:07,240
I was given therapy,
evaluations and assessments.

945
00:53:07,240 --> 00:53:13,080
I would put all of that information
into a programme called the Predict,

946
00:53:13,080 --> 00:53:18,440
<font color="
a recommended discharge date.

947
00:53:18,440 --> 00:53:21,000
Having an estimate of when somebody

948
00:53:21,000 --> 00:53:25,240
is going to no longer need
specialist nursing care,

949
00:53:25,240 --> 00:53:28,880
there's nothing wrong
with that in theory, though, right?

950
00:53:28,880 --> 00:53:32,000
Patients always do best
<font color="

951
00:53:32,000 --> 00:53:37,640
But if they're not safe at home,
you have to do it in rehab.

952
00:53:37,640 --> 00:53:39,560
How often was that number of days

953
00:53:39,560 --> 00:53:42,200
about the right ballpark
as you saw it?

954
00:53:42,200 --> 00:53:45,800
Probably 20% of the time. Really?

955
00:53:45,800 --> 00:53:48,120
Mm-hm. 20, 25%, yeah.

956
00:53:48,120 --> 00:53:51,440
<font color="
sometimes less?

957
00:53:51,440 --> 00:53:55,200
Generally, it would be
three to four days under.

958
00:53:55,200 --> 00:53:58,400
They liked to say
that the Predict took in

959
00:53:58,400 --> 00:54:01,880
6 million patients' experiences.

960
00:54:01,880 --> 00:54:07,480
I still believe that as humans,
we made better decisions.

961
00:54:07,480 --> 00:54:09,440
<font color="

962
00:54:09,440 --> 00:54:11,640
Can you use
your human judgment instead

963
00:54:11,640 --> 00:54:13,960
if you saw that it was wrong?

964
00:54:13,960 --> 00:54:16,480
Wouldn't that be great?

965
00:54:13,960 --> 00:54:16,480
SHE LAUGHS

966
00:54:16,480 --> 00:54:18,280
Unfortunately, no.

967
00:54:18,280 --> 00:54:22,960
The expectation was
I would stay within 3%

968
00:54:22,960 --> 00:54:25,520
<font color="

969
00:54:25,520 --> 00:54:30,080
but by the time I stopped working,
it was down to 1%.

970
00:54:30,080 --> 00:54:33,120
1%? 1%.

971
00:54:33,120 --> 00:54:38,440
That means this patient who is
very sick and can't get out of bed,

972
00:54:38,440 --> 00:54:40,720
guess what -
ten days, you're out of here.

973
00:54:40,720 --> 00:54:42,720
<font color="

974
00:54:43,880 --> 00:54:47,320
I always made it very clear
that I was just the messenger.

975
00:54:47,320 --> 00:54:49,560
I do not make the decisions.

976
00:54:49,560 --> 00:54:53,120
I had members' families
scream at me.

977
00:54:53,120 --> 00:54:54,760
How did that feel?

978
00:54:54,760 --> 00:55:00,400
Awful, because I wanted to just say,
"No, I 100% agree with you.

979
00:55:00,400 --> 00:55:04,520
<font color="
should be discharged right now."

980
00:55:04,520 --> 00:55:06,880
But I wasn't allowed to.

981
00:55:06,880 --> 00:55:10,040
They expect you
to meet these certain goals,

982
00:55:10,040 --> 00:55:12,680
and the problem is
if you don't meet them,

983
00:55:12,680 --> 00:55:15,240
then you're costing the company
too much money,

984
00:55:15,240 --> 00:55:20,120
<font color="
as a care coordinator.

985
00:55:20,120 --> 00:55:23,680
So, you as an employee
have repercussions if you don't...

986
00:55:23,680 --> 00:55:25,520
Yes. If you don't stick with it.

987
00:55:25,520 --> 00:55:28,040
..if these patients
don't get discharged

988
00:55:28,040 --> 00:55:31,360
within 1% of the date
that the algorithm says.

989
00:55:31,360 --> 00:55:34,520
<font color="

990
00:55:34,520 --> 00:55:37,080
That was part of the reason
that I was let go.

991
00:55:37,080 --> 00:55:41,040
It was all about the dollar
and I hated that.

992
00:55:45,680 --> 00:55:48,320
Amber really cares about
her patients.

993
00:55:48,320 --> 00:55:50,080
I mean, that is so obvious.

994
00:55:50,080 --> 00:55:56,360
<font color="
by what she was being asked to do.

995
00:55:56,360 --> 00:56:01,880
Where this has fallen down has been
in the fact that it is so inflexible.

996
00:56:05,640 --> 00:56:08,880
And it's this -
the idea that we might ultimately

997
00:56:08,880 --> 00:56:11,920
give up control from humans
to machines -

998
00:56:11,920 --> 00:56:15,160
<font color="
the feelings of injustice

999
00:56:15,160 --> 00:56:17,600
that can arise
when technology clashes

1000
00:56:17,600 --> 00:56:19,920
with human pain and suffering.

1001
00:56:21,560 --> 00:56:24,080
HORNS BEEP

1002
00:56:26,720 --> 00:56:30,320
In New York, jury selection
in Luigi Mangione's trial

1003
00:56:30,320 --> 00:56:32,880
is scheduled to begin
<font color="

1004
00:56:32,880 --> 00:56:36,200
CHANTING: One struggle, one fight!
Healthcare is a human right!

1005
00:56:36,200 --> 00:56:40,680
..and it's bound to elicit
yet more controversy on all sides.

1006
00:56:40,680 --> 00:56:44,760
His supporters hope those jurors
will deliver a radical verdict.

1007
00:56:44,760 --> 00:56:47,720
We have a feature
<font color="

1008
00:56:47,720 --> 00:56:51,640
called jury nullification,
where if a jury believes

1009
00:56:51,640 --> 00:56:55,920
that a not-guilty verdict would be
the best delivery of justice,

1010
00:56:55,920 --> 00:56:57,960
they can deliver
a not-guilty verdict

1011
00:56:57,960 --> 00:57:02,880
regardless of whether they think the
<font color="

1012
00:57:02,880 --> 00:57:06,720
CHANTING: The people united
will never be defeated!

1013
00:57:15,040 --> 00:57:19,360
My time in the US had made me
think about our fate in the UK.

1014
00:57:21,640 --> 00:57:27,000
AI is already being used in the NHS,
but it's being done with caution

1015
00:57:27,000 --> 00:57:30,520
<font color="
with human supervision -

1016
00:57:30,520 --> 00:57:34,960
a tool to support humans,
not to override them.

1017
00:57:34,960 --> 00:57:38,320
And for me,
that is when AI is at its best -

1018
00:57:38,320 --> 00:57:40,080
not something to be feared,

1019
00:57:40,080 --> 00:57:44,560
but something to be carefully
incorporated into our lives.

1020
00:57:44,560 --> 00:57:48,000
<font color="
extraordinary things,

1021
00:57:48,000 --> 00:57:53,160
but this is a revolution that
has to happen with us, not to us.

1022
00:58:22,080 --> 00:58:26,080
To discover more about AI
and how it can shape our future,

1023
00:58:26,080 --> 00:58:28,600
go to...

1024
00:58:32,080 --> 00:58:35,520
..or scan the QR code
on the screen now.


